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Abstract. In this paper, we consider a dynamic and decentralized market modeled by a non- 
cooperative networked bargaining game. Our goal is to study how the network structure of the 
market and the role of middlemen influence the market's efficiency and fairness. We introduce 
the concept of limit stationary equilibrium in a general trading network and use it to analyze how 
endogenous delay emerges in trade and how surplus is shared between sellers and buyers. 

o 

(N 

(D 1. Introduction 

In many markets, trade does not involve simply sellers and buyers but also one or more middlemen 
,__( serving as intermediaries. For example, brokers and market makers fill this role in financial markets. 

Often, different buyers and sellers may not have access to the same set of middlemen due, for 
^ I example, to various institutional or physical barriers. Such relationships are naturally modeled via 

r i-\ a network. Understanding how the structure of this network effects the resulting market has been a 

topic attracting increased interest. This is partly due to the fact that on one hand, such questions 
Q are not adequately answered by classical economic models, while on the other hand phenomena, 

'— ' such as the recent financial crisis, suggest the importance of answering them. 

A key question for network markets is explaining how prices form in such settings, which is a 
I> basic function of middlemen. Classic approaches such as competitive equilibrium analysis abstract 

away such questions as pointed out in the following quote from [T^ : 

OO Despite the important role played by intermediation in most markets, it is largely 

CN ignored by the standard theoretical literature. This is because a study of interme- 

CsJ diation requires a basic model that describes explicitly the trade frictions that give 

rise to the function of intermediation. But this is missing from the standard market 

models, where the actual process of trading is left un-modeled. 

^ In recent years there has been a growing literature addressing such concerns including [161 1121 [13 13 

[T^ [3] . This paper adds to this line of literature by studying non-cooperative bargaining in general 
network with middlemen similar to the network markets considered in [4j. Here, instead of price- 
setting agents, we consider non-cooperative bargaining: middlemen do not have full bargaining 
power as in [3j. In particular, we incorporate the non-cooperative bargaining model of [14J and 
add to it elements of search friction and generalize the trade network by allowing multiple trade 
routes. In this model, each node in a trade network consists of a population of agents. Non- 
cooperative bargaining occurs between pairs of agents that in adjacent nodes. As in [H], we study 
study the agents' behavior in the limit of large population sizes via the notion of a limit stationary 
equilibrium^ 

We show existence of limit stationary equilibrium, and use this concept to investigate the effi- 
ciency of market, how bargaining with middlemen cause endogenous delay in equilibrium, and how 
network structure cause imbalance/unfairness in the share of surplus between sellers and buyers. 
These properties cannot be captured without non-cooperative and dynamic bargaining models. 



X 



"'^Further comparison with the existing literature is discussed in Section 3, where the solution concept of limit 
stationary equilibrium is introduced. 

1 



2 RANDALL A. BERRY, THANH NGUYEN, VIJAY SUBRAMANIAN NORTHWESTERN UNIVERSITY 

Our model and results give new economic insights into the combination of micro market mecha- 
nisms with a network. In particular, on how sunk-cost problems cause delays in trade for a dynamic 
model. This should be contrasted with static models in classical theory that predict no trade. In 
comparison to [H] where the absence of search friction can cause nonexistence of stationary market 
equilibria, here we show how slowing down trade with search friction can reestablish stationary equi- 
libria. We show that with the presence of search friction, stationary equilibrium can be sustained, 
even with the possibility of multiple trade routes where the cheapest trade routes are preferred. 
This might suggest a direction for further research on the impact of trading speed on the dynamic 
behavior of an economy. However, inefficiency persists, in particular, in the new bargaining model, 
the strategy in which agents trade immediately whenever they meet a potential trading partner 
cannot be sustained at equilibrium unless the value of the good is high enough for the buyer; trade 
sometimes is delayed. Our results also reveal several interesting and non-monotonic properties of 
the equilibrium. 

The remaining of the paper is organized as follows. Section 2 introduces the baseline non- 
cooperative bargaining model. Section 3 discusses the solution concept of limit stationary equilib- 
rium, Section 4 examines comparative analysis in some simple networks, and Section 5 concludes. 

2. The Model 
In this section we introduce the model that we will use. 

Trading Network. We consider a group of sellers, buyers and middlemen interconnected by an 
underlying trading network, which is modeled as a directed graph, G = (V,<5) (see Figure [T]). 
Each node i € V represents a population of Ni agents, all of which are either buyers, sellers or 
middlemen. Hence, we can partition the set of vertices into the following three disjoint sets: a set 
of sellers denoted by X, a set of middlemen denoted by J', and a set of buyers denoted by IC. An 
agent from the population at a node i will sometime be referred to as a type i agent. Trade "flows" 
over directed edges, i.e., a directed edge G £ indicates that a type i agent can potentially 

directly trade with any type j agent. With a slight abuse of terminology, we often refer to two such 
agents as being connected by the edge For a buyer to acquire a good from a seller, there 

must be a (directed) path from the buyer to the seller. If this path has length 1 then the two can 
directly trade, otherwise they must rely on middlemen to facilitate the trade. For simplicity, we 
consider networks in which any path between a buyer and seller contains at most one middleman, 
i.e all such paths are either length 1 or 2. An example of such a network is shown in Figure [T} 
With this assumption, the set of directed edges, £ can also be partitioned into three disjoint sets: 
those that directly connect sellers to buyers denoted by £i , those that connect sellers to middlemen 
denoted by £2., and those that connect middlemen to buyers, denoted by £^. 

Sellers Buyers 




Figure 1. A network among sellers, buyers and middlemen 



BARGAINING WITH MIDDLEMEN 



3 



We assume that there is one type of indivisible good in this economy. All sellers produce identical 
goods and all buyers want to acquire these goods. The value that each buyer of type k £ IC gets 
from an item is Vk > 0. At every period each agent can hold at most one unit of the good (an 
item). Thus, every time period, a middleman either has an item or does not have one. Hence, if 
there is a directed edge from node i to node j, a specific agent of type i can only trade with an 
agent of type j if the type i agent has a copy of the good and the type j agent does not; we refer 
to such a pair of agents as feasible trading partners. Note that sellers are assumed to always have 
a good available to trade and buyers are always willing to purchase a good. So for example, any 
two agents connected by an edge in the set Ei are always feasible trading partners. For every edge 
S £, we associate a non-negative transaction cost Cij > 0; this cost is incurred when trade 
occurs between an agent at node i and one at node j. 

The Bargaining Process. We consider an infinite horizon, discrete time repeated bargaining game, 
where agents discount their payoff at rate < 6 < 1. (The model can be extended to allow for 
heterogeneous discount rates.) Each period has multiple steps and is described as follows. 

Step 1. One among all pairs of directly connected nodes {i,j) & £ is selected at random with a 
predetermined probability distribution TT{i,j) on the set of edges £ and one node from each of the 
corresponding populations is selected uniformly at random. One of these agents is further selected 
to be a proposer (again chosen at random). 

Step 2. If the agents are not feasible trading partners, then the game moves to the next period 
and restarts at step 1. Recall that this will occur if neither agent has the good or if both have the 
good. 

Step 3. The proposer makes a take-it-or-leave it offer of a price at which he is willing to trade. 
If the trading partner refuses, the game moves to the next period. Otherwise, the two agents trade: 
one agent gives the item to and receives the money from the other, and the proposer pays for 
the transaction cost Cijj^ If a buyer or seller participates in a trade, they exit the game and are 
replaced by a clone. On the other hand, middlemen are long lived and do not produce nor consume; 
they earn money by flipping the good. 

Step 4. The game moves to the next period, which starts from Step 1. 

The game is denoted by r(^, C, V, N, 6), where C denotes the vector of links costs, V denotes the 
vector of buyer valuations and N denotes the vector of population sizes at each node i. Sometimes, 
we will simply refer to this game as T. 

Remark. By appropriately choosing the distribution vr and the choice of proposing agent when trade 
takes place, we can equivalently view the dynamics from the perspective of the agents such that 
the agents are picked independently (following some distribution) to be proposers and depending 
on the state of the agent (i.e., if the agent possesses the good or not), one among the appropriate 
edges is chosen following a distribution. Note that there is a possibility that the proposing agent 
might pick an edge along which no trade is possible owing to the picked agent having the same 
state as the proposing agent. This leads to search friction and can be contrasted with the model in 
|14j in which the proposing agent is always able to find a feasible trading partner if one exists. We 
prefer to model the dynamics from the perspective of edges as it is more general and fully subsumes 
the node perspective. 

Replicated Economy. Given the bargaining game T{Q,C,V,N,6), the game's replications are de- 
fined as a game of the same structure, except the population size is increased by a factor of m, and 
the time gap between consecutive periods is reduced by a factor of T^- Formally this is defined as 
follows: 



Actually, it does not matter who pays for this transaction cost, because the transaction cost is reflected in the 
proposing price. 
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Definition 2.1. Given the game T{g,C,V,N,6) and m,T„i G N+, let 6' = 5^/'^^. Then the 
(m, Tm) -replication of T, denoted by TJp^^^{Q, C, V, N, 6) is defined as T(g, C, V, niN, 5'). 

Remark. The changing of discount rate 6 is commonly used in the study of dynamical systems. 
It is clear that without changing 6, in the replicated economy each agent will need to wait for a 
longer and longer time to get selected, and thus his pay-off approaches 0. If initially each period 
takes one unit of time, then note that changing the discount rate to 6' = (^^/^™ is mathematically 
equivalent to changing the time gap between periods to become l/T^ time units and keeping the 
discount rate fixed. Hence, for example, if we choose Tm = c • m, it means we keep the rate that 
each agent see trading opportunities on the same order as in the original finite game. On the other 
hand » m models a setting in which the rate at which agents trade at is increasing. In this 
paper, for simplicity, we will focus on the case Tm = m. Other choices of Tm do not affect our 
results, qualitatively. 

3. Solution Concept and its Existence 

Next we turn to the solution concept considered in this paper, which following [H] we call a limit 
stationary equilibrium. This is an equilibrium in which all players employ stationary strategies, 
defined as follows: 

Definition 3.1. A strategy profile (possibly mixed strategy) is called a stationary strategy if it only 
depends on an agent's identity, his state (owning or not owning and item) and the play of the game 
(which agent he is bargaining with, who is the proposer and what is proposed). More precisely, for 
example, assume that agent i and agent j are selected to bargain, and assume i owns an item, j 
does not, furthermore i is the proposer, then in this case a stationary strategy of the agent i is a 
distribution of proposing prices to agent j and a stationary strategy of the agent j is a probability 
of accepting the offer. 

Loosely, a limit stationary equilibrium in a profile of stationary strategies with two properties: 

(1) Each agent's stationary strategy maximizes their expected pay-off assuming given proba- 
bilities /ij for all j G which indicate the probability that a middleman selected from 
the population at node j owns a good in any period (equivalently, /Xj can be viewed as the 
steady-state fraction of middlemen owning a good). 

(2) The assumed probabilities are required to be consistent with the given stationary strategies 
in the limiting replicated game as m increases without bound. 

Such an equilibrium can be viewed as a type of fulfilled or rational expectations equilibrium (see 
e.g., [10]) in that agents can be viewed as making decisions based on a belief about the stationary 
probabilities (property 1) and these beliefs are required to be consistent with their resulting actions 
(property 2). Note that without taking the limit of large m, assuming such time-invariant proba- 
bilities is clearly not reasonable; for example, whenever a trade from i to j occurs it would increase 
the fraction of nodes at j holding an item and thus change this probability. However, in the limit 
of replicating the game such effects become negligible and as shown in the following, such equilibria 
do exist. A limit stationary equilibrium is also similar to the equilibrium concept used in mean-field 
games [U El [3 El [11] in that the agents react to the distribution of actions (here possessing a good 
or not) of all the other agents. However, in contrast to the literature on mean-field games, here 
the agents are heterogenous with different agents reacting to the distribution of specific types of 
agents. 

We will precisely define this equilibrium in this section. Before doing this, we will consider the 
first of the preceding properties and derive incentive constraints that an agent's stationary strategy 
needs to satisfy. We then turn to the second property, which involves considering a fluid limit of 
an underlying Markov process. After doing this, we combine these considerations to define this 
solution concept and further show that such an equilibrium always exists. 
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3.1. Incentive Constraints. To derive the needed incentive constraints, assume that each agent 
chooses an optimal stationary strategy to maximize their expected discounted pay-off given a set 
of probabilities {^j : j G J}, which as discussed previously give the fraction of middlemen at each 
node j that hold an item at any time. In particular, in this setting the expected pay-off |^ of agent 
i will only depend on whether he has or does not have a good, which we denote by uo(i) and iii(i), 
respectively. Notice that because of the assumption that sellers and buyers exit the market after a 
successful trade, we have mo(^) = for every seller i e X; and ui{k) = Vk for every buyer k £ IC. 

Consider the situation when edge {j, k) is chosen and a corresponding middleman of type j £ J 
who possesses an item is chosen to be the proposer to a buyer of type k £ IC. Again, abusing 
notation, we will refer to the specific chosen agents from the two populations as j and k. If the 
trade is successfully completed, then k possesses the item, thus agent j will demand from agent k 
the difference of the payoffs between the states before and after the trade (discounted by 5). Note 
that the state of j also changes, and therefore, if trade is successfully completed, then j's payoff is 

SuoU) + S{ui{k) - uo{k)) - Cjk- 

However, agent j has the option of not proposing a trade (or proposing something that will neces- 
sarily be rejected by the other party) and earn a payoff of 5ui{j). For ease of exposition define the 
difference to be 

(1) Zjk{^) := s(^ui{k) - uo{k) - {ui{j) - uo(j))) - Cjk- 

At equilibrium, the following properties, which we call the consistency conditions, will hold. 

Definition 3.2 (Consistency conditions). (1) If 5ui{j) > 6uo{j) + 6[ui{k) — UQ{k)) —Cjk, i.e., 
if Zjk{^) < 0, then agent j will never sell an item to agent k; 

(2) If 6ui{j) < duo{j) + 6[ui{k) — uo(fc)) — Cjk, i.e., if Zjk{5) > 0, then agent j will sell the 
item to agent k with probability one whenever they're matched; and 

(3) If 5ui{j) = 6uo{j) + d[ui{k) — uo{k)) — Cjk, i.e., if Zjk{S) = 0, then agent j is indifferent 
to the trade happening or not, so that the trade occurs with some probability Xjk G [0, 1]. 

From the third property above, it is clear that if trade between agents j and k occurs with 
probability < Xjk < 1, then we must have Zjk = 0. Irrespective of whether the trade occurs or 
not, the payoff of agent j is 

5ui{j) + max{zjk{5), 0}. 
Accounting for all events, the expected payoff of agent j G J', when possessing the good is 

fc:(i,fc)e£-3 ^ \ k:{j,k)eSs V 

Since agent k G IC departs as soon as she receives the item, and is replaced by a clone who does 
not have an item, with probability 1 agent j will find a feasible trading partner of type k. The 
expected payoff must satisfy the Bellman equation so that 

(2) ni(i)= Yl ^{Sm{j) + ma^{z,k{S),0}) + ll- ^ ^] ^^j)- 

k:(j,k)(^£3 ^ \ fc:(i,fc)6f3 V 

After some algebraic manipulations, this is equivalent to 

(3) uiij)= E 2n7i-5) ^^^{^Jk{S),0}. 

k:{j,k)ee3 ■'^ ' 

To avoid cumbersome notation we will use the same symbols for the payoffs for both finite m and m — >■ oo. 
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Cij 



Now consider the case of middleman j ^ J that does not have an item and is the proposer. She 
has to trade with a seller i G X to whom she is connected to. If the trade is successful, then payoff 
of agent j is 

5ui{j) -5[ui{i) - uo{i)) - Cij, 

where 5{ui{i) — uo{i)^ is the sum demanded by agent i. This has to be compared with 6uQ{j), the 
payoff for not trading at the current opportunity. Again define 

(4) Zji{5) = 6(ui{j) - uo{j) - {ui{i) - uo{i))^ 
so that the payoff of agent i is 

6uQ{i) + max{zji{d),0} 

where the value of Zji{6) determines whether trade happens. 

Following the same steps as when agent j had the good, we get the expected payoff to be 

(5) ^^o(j) = Yl 2nTi- 5) 0}- 

Using similar arguments, we can write the payoffs for every agent in our system as follows: 

(1) Payoffs for sellers without an item are always 0, i.e., 'Uo(i) = for all i G I. Additionally, 
buyers with an item have their valuation as their payoff, i.e., ui{k) = Vj. for all k G IC; 

(2) Seller i G I is chosen and has an item to sell. Depending on the graph Q, the seller can 
trade with a middleman or directly with a buyer. The expected payoff is given by 

(6) ui{i)= 2n7i- 5) + Y 2mi- 5) ~ 0) 

where 

(7) Zik{6) = 6(^ui{k) - uo{k) - {ui{i) - uo{{))^ - Qk, 

(8) Zij{5) = 5(^ui{j) - uoU) - {ui{i) - uo{i))^ - Cij. 

Here, recall that Ni is the size of population at node and thus, for every j G J , ^(l — fij) 
is the probability that conditional on holding an item, i is matched with j that does not 
hold a good and i is the proposer. Note that search friction impacts the transaction between 
the seller and the middleman; 

(3) Buyer k £ IC is chosen and does not have an item. Again, depending on the graph G, 
the buyer can trade with a middleman who has a good or directly with a seller. We set 
Zki{S) = Zik{6) and Zkj{6) = Zjk{5). The expected payoff is 

(9) uo{k)= Y 2N^{1- 5) + Y 2Nk(l- 6) ''^'^ ' ' 

Here too we incorporate search friction, so that given a buyer k £ IC, for every j £ J , 
2^1^ j is the probability that conditional on not holding an item, k is matched with j that 
holds a good and k is the proposer. 

As the economy gets large, we need to consider the behavior of equations ([s]), Q, ([5]) and ([9]), 
where Nj is replaced by mNj and 5 is replaced by 5^/™, as m increases without bound. Since 
the payoffs are non-negative and are bounded by max^g/c Vfc, along subsequences, limits exist; by 
relabeling, if necessary, consider any such subsequence. We will now discuss properties of any such 
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a subsequence limit. First note that linij^_^oQ m(l - (Ji/'") = ln{l/S). Then we get the following 
equations holding at each limit point: 



(10) 



+ E 2Ar,rn(lA)^'"^^-^"^'"^'^^''^' 
i:(i,j)ef2 * ^ / ^ 



(11) VjGj no(i)= E 2jvTn(lM) max{z,,,0}, 



(12) VjGj ni(j)= E 2iV h!nM) max{z,,,0}, 



(13) 



VfcG/C ^o(fe)= E 2jvJn(lM) 

+ E 2ivJn(l/5)^^""""^"^^'°^' 
where we have 

(14) = Zki = (^ui{k) - uo{k) - {ui{{) - lio(O)) - C'ifc 

(15) Zij = Zji = (^ui{j) - uo{j) - {ui{i) - uo{i))^ 

(16) Zjk = Zkj = (ui{k) - uo{k) - {ui{j) - no(i))) 



Cij] 



jk- 



Notice that by definition, as we consider the replicated game with larger and larger population, we 
also need to change the discount rate 6 by (5^/™". As m approached infinity, 5^/™- becomes 1. As a 
result, ([14])-([16J) are obtained as limits of 0, ^ and (|7])-@- 



We summarize the derivation by the following result. 



Theorem 3.1. Given {fj,j : j G J}, every limit point of the replicated game T satisfies (10)-(16) 



3.2. Limiting Trade Dynamics. In the previous section we derived a set of constraints that an 
agent's stationary strategy would need to satisfy given that the fraction of middlemen owning an 
item at each node j is equal to a constant probability fij. Recall that such a strategy is characterized 
by a set of probabilities Xij for every edge £ £, which denotes the probability of trade occurring 
among a pair of feasible trading partners of type i and j. If Xij = 1, trade always occurs and if 
Xij = it never occurs. Given any such a stationary strategy, the resulting dynamics can be viewed 
as a Markov process. In this section we consider the behavior of such a process for the replication 
of a game as m increases without bound. The main result is that for such processes, in the limit 
the fraction of middlemen at each node j does indeed converge to a fixed probability /ij . 

To begin suppose that there is a fixed fraction of middlemen fij at each node j & J that hold 
the good for all time. We extend this to the sellers by setting /i,, = 1 for all i G X and the buyers 
by setting /i^ = for all k £ IC. The given values {fij : j G J'} must obey a balance condition: 
for every node j G JT", in every period the probability that the amount of goods held at node j 
increases by one or decreases by one should be equal. Mathematically, the balance condition can 
be written as 

(17) E '^jkH (1 - ^fc) V = E (-*■ ~ ^ ^• 

Here, for example, TTjkfJ-j (1 — fJ-k) Xjk is the probability that trade occurs from j to k, which requires 
that link {j,k) is selected (with probability TTjk), that j and k are feasible trading partners (with 
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probability — fik)) and that trade occurs (with probabihty Ay). While the use of {/Uj : i £ 1} 
and {fik ■ k £ fC} above is for mathematical convenience, in more general networks where we allow 



middlemen to trade with each other, expressions similar to (17) will hold as the balance condition 
for every middlemen type where the terms will involve the state of other middlemen as well. 

We will prove the existence of Hj satisfying this balance condition by analyzing the Markov 
process that drives the state of the system, for a given set of stationary strategies {Xij}- Since the 
state of middlemen can change with time, the entire system can be represented by a vector-valued 
random process {X™(t) : j G iTj^^i where for the m replicated system we keep track of the number 
of agents who have the item at each middleman type j G J . For mathematical convenience, we 
win append {Xf (f) : i G X} where (t) = mNi and {X]^{t) : k £ IC} where X]^{t) = for the 
states of the sellers and the buyers, respectively. Since sellers exit the game as soon as they sell 
their good and are replaced by a clone with a good, at any given time any seller always possesses 
a good. A similar reasoning holds for the buyers never having a good. 

For the m**^ replication, the state transitions are given as follows for each j £ J 

'min(miVj-,Xj(t) + 1) w. p. pj(+l) 
Xj(i + 1) = <! max(0,Xj(t) - 1) w. p. /9j(-l) 

X,(t) w. p. l-p,(+l)-p,(-l). 



where 



if) s 



ieX:(i,i)e£:2 

is the probability that an agent of type j acquires a good in a given period, and 

^ keK::{j,k)&S:i 

is the probability that a type j agent sells a good in a given period. As noted above, the states 
corresponding to sellers in I and buyers in /C are fixed for all time. 

This shows that we have a Markov process. Since the transition matrix satisfies Lipschitz condi- 
tions, we can analyze the fluid limit that is obtained by scaling time and space, i.e., by considering 
the process {X^{t) : v £ V}, where 

m 

We will analyze the behavior of the process {X™(t) : v £ V}teR^ when m increases without bound. 
Note that this the exact scaling considered by the replicated systems. We then have the following 
result. 

Theorem 3.2. Given a set of probabilities for trade {Xij, {i,j) £ £}, the trading dynamic process 



described above converges to an unique state, which is the unique solution of (17) given by 
(18) Vi £ I, fii = 1; VA: £ fC, fJ-k = 0; 



Proof. See Appendix |A.1[ □ 

Note that {fij : j £ is a continuous function of {Xik ■ {i,k) £ £}. When middlemen are 
allowed to trade with each other, a subtler proof based on a fixed-point theorem can be used to 
show a similar result. 
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3.3. Equilibrium. Given the discussion about the incentive constraints and the convergence of 
the game dynamics above, we are now ready to define the solution concept of limit stationary 
equilibrium in this bargaining game. Loosely, as discussed previously, a limit stationary equilibrium 
is a profile of stationary strategies with two properties: 

(1) Each agent's stationary strategy maximizes their expected pay-off assuming given proba- 
bilities fij for all j € J, which indicate the probability that a middleman selected from the 
population at node j owns a good in any period. 

(2) The assumed probabilities are required to be consistent with the given stationary strategies 
in the limiting replicated game as m increases without bound. In particular, in the limiting 
game, for each agent, there will be two numerical values indicating the expected payoffs of 
agents at different state (owning/ not owning an item). A consistency requirement poses 



constraints between these payoffs and the stationary strategies similar to Definition 3.2 



Definition 3.3 (Limit Stationary Equilibrium). Given a stationary strategy, let < Xij < 1 be the 
overall probability that trade between i having a good and j wanting to buy one occur conditioned on 
the event that they are selected by the matching process. Let fj, be the unique converging steady state 
of the random process defined by Xij, as discussed at the beginning of this section. Furthermore, 
let UQ{i),ui{i) be the expected payoff of agent i under the random process defined with Xij. This 
stationary strategy is a limit stationary equilibrium if 

(1) Dynamic-state consistency: fi is the converging state of the dynamic defined with X, that is 



X,fi satisfy (18)-(19); 



(2) Payoff-state consistency: X,^,u satisfy the incentive constraints defined in (10)-(16); and 



(3) Pay off- dynamic consistency: if Zij > then Xij = 1; if Zij < then Xij = 0; and if 



< Xij < 1, then Zij = for all links (ij) in the network Q , and are defined in (14)-(16). 



We next show that a limit stationary equilibrium always exists. The proof of this theorem is based 
on the standard fixed-point theorem argument. For completeness, we provide such a detailed proof 
in the appendix. Notice that the equilibrium might not be unique; however, in the next section, 
we show several simple networks in which such an equilibrium is unique and exhibits interesting 
properties. 

Theorem 3.3. For a bargaining game, T{Q ,C ,V ,N ,5), a limit stationary equilibrium always ex- 
ists. 



Proof. See Appendix |A.2 □ 



4. Comparative Studies 

In this section we will focus our comparative studies on when the discount factor 6 approaches 
1, in which case we sometimes refer to as when "agents are being patient" or "vanishing bargaining 
friction" |^ We start by showing that despite the local bargaining set-up, a global efficiency emerges 
in the equilibria. In the rest of the section we give some comparative statics on how the network 
structure influences the payoffs and trade patterns in our model. 

4.1. Efficiency. 

Corollary 4.1. Given a seller i and a buyer k, there exists 6* , such that for all 6 > 6* and at any 
equilibrium the following is true. If Xij > and Xjk > for a middlemen j, that is trade occurs 
along the route i ^ j ^ k, then the cost Cij + Cjk is the smallest among all trading routes between 
i and k. 



Again we drop the explicit dependence on S for the payoffs, trade probabiUties and stationary state of the 
middlemen. 
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Remark: The above result demonstrates a global-level efficiency that emerges in the equilibria of 
the local non-cooperative bargaining scheme if agents are patient enough: edges that are not along 
a cheapest path from any seller and buyer pair are never used, and middlemen who have no edges 
along a cheapest path from any seller and buyer pair see no trade. Note that there is no claim that 
either all or even any of the cheapest path routes between a given seller and buyer pair are used in 
an equilibrium. 



Proof. Consider equations ([10|), ([TT|), (12) and (13). As S approaches 1, the log(l/5) term ap- 



proaches 0. Since ui{j),uo{j) G [0,max;fcgx: ^fe] for all j E J, ui{i) S [0,maxfcg/(; V^] for all i E I, 
and uo{k) G [0, max^g/c ^fc] for all A: G /C, it has to be that given any e > 0, there exists 6* such 
that for all 6 > 6* , we have 

Zik < e V(i, k) £ £i, 

Zjk < e V(i, k) £ £3. 

Now consider a pair of agents, one seller i and buyer k. We have three cases then: 

(1) All trade routes from ito k have to visit some middleman. Let j £ J he one such middleman 
so that G £2 and (j, k) G £3. The inequalities above then imply the following: 

ui{j) - uo{j) > ui{k) - uo{k) - Cjk - e, 
uiU) - uoU) < - uoii) + Cij + e. 
These with uo{i) = and ui{k) = imply 

ui{i) + uo{k) > Vfc - Cij - Cjk - 2e. 

Note that this inequality holds for every j £ J that lies along a trade route from i to k. 
Therefore, 

ui{i) + uo{k) > Vk - min ( Q,- + C,a, ) - 2e. 

Because e can be chosen arbitrarily small, thus for any middleman j who is not on a smallest 
transaction cost path from i to fc, we can choose b close enough to 1 such that either Zij or 
Zjk is strictly negative and so no trade can occur on the corresponding edge; 

(2) Notice that the same argument also works for the case, where if in addition to the middle- 
men, there also exists a direct link between i and k. Then 



ui(i) + uo(A;)>VA,, -min Cjfe, min + C,fc 

V {i:{i.i)e^'2 and (j,fc)e£-3} V 

Again it is clear that no trade occurs over links that are not part of a smallest transaction 
cost path from i to k; 

(3) If i and k only have a direct route between them, then that is the only route via which 
trade can occur between this seller and buyer pair. Also, if no routes exist between i and 
k, then obviously no trade occurs between these two agents. 

□ 



A refined analysis is needed to distinguish between multiple cheapest routes in order to determine 
which ones get used; the division of the transaction cost, in particular, the values closer to the seller, 
allow us to differentiate between the multiple cheapest routes. 
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4.2. Endogenous Delay. We now consider a simple network that consists of two links. This 
network represents the simplest example where sellers and buyers cannot trade directly. We fully 
characterize the limit stationary equilibrium in this example, which will be shown to be unique. 
Even in this simple network, we observe an interesting phenomenon of endogenous delay as part 
of the equilibrium. This is counterintuitive since in a full information dynamic bargaining model 
like ours, delay in trade does not enable agents to learn any new information, but only decreases 
the total surplus of trade. Therefore, the network structure and the combination of incentives of 
long-lived and short-lived agents are the main sources causing this inefficiency in bargaining. 

© — ^ © ® 



Figure 2. Network 



Assume a, b are transaction costs of the first and second link, also let V be the value of the 
consumption of the good; without loss of generality we will insist that trade is favorable so that 
V > a + b. Abusing notation we will index the links as a and b. The probability of using the 
links is then (tTq,?!;,). We assume the population sizes at every node is equal, and without loss of 
generality, we assume A^i = N2 = N3 = 1. From this point onwards, we will also assume that 
we start with exactly one agent at each location We will show that in this simple network, the 
stationary equilibrium is unique, and we characterize the condition on which agents do not trade 
immediately. 

Theorem 4.2. When the agents are patient, there is always a unique limit stationary equilibrium. 



Furthermore, ifV> ( 1 + 



a-\-b=: V, then trade always happen, otherwise there is a delay. 



The probability of trade, the payoffs and the equilibrium state of the middleman are given by 



Afc = 1, 



V-b-a 



uo{k) 



(V-b)(2- 



(V-b)(2- 



1 



ifV>V 
otherwise ' 

ifV>V 
otherwise 

ifV>V 
otherwise 



nb{V-b-a) 

. ■7Ta{2a+b-V) 



ifV>V 
otherwise ' 



1+ 



{7ra+Ti,)2 



V- 1 + 







ifV>V 
otherwise 

ifV > V 
otherwise. 



Remark: Note that trade always occurs on link b but can be delayed at link a. Since the buyer 
is at the other end of link 6, it stands to reason that there is no delay in the trade. However, at 
link a, any sale of the item results in a decreased likelihood of the trade at the same link (in the 
near future) and this opportunity cost introduces the delay in trade. Note also that with a delay 
in trade, the seller obtains no surplus! We will revisit this effect in the next section. Trade gets 
delayed when the value of the good is below a specific threshold. From the proof one can discern 
that the additional penalty term in the threshold is the product of the transaction cost at link 
a and the stationary probability that the middleman possesses the good. This can be viewed as 
a carryover of the sunk cost at the second stage and should be contrasted with the result in 
where the additional penalty without search friction is the entire transaction cost at link a. 



Proof. See Appendix |A.3 



□ 



Following the proofs of our results, it will become clear that this assumption does not result in any loss of 
generality when agents are patient. 
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4.3. Fairness. Lastly, we consider tlie imbalance between the surplus of sellers and buyers as a 
result of our decentralized trade model. 




Figure 3. Network 

Consider the following (also simple) network, where node 1 represents sellers, node 2 represent 
buyers and node 3 represents middlemen, as illustrated in Figure [3j Again without loss of generality, 
we assume thatA'^i = N2 = = 1. We also assume that in our bargaining model, every link is 
selected uniformly at random, that is Tiij = 1/3 for all i ^ j- Assume the buyer's valuation for the 
good is V2 = 4, and the transaction costs are the following: C12 = 3, C32 = and C13 = 4 — x. We 
will investigate the equilibrium as x changes. As x increases, the transaction cost between 1 and 3 
decreases, making the total trade surplus max{4 — 3, 4 — (4 — x)} = max{l, x} increase. 

The surplus of sellers in this example is understood as the payoff of agent at node 1 when owning 
an item: ui{l). On the other hand, the surplus of buyers in this example is the payoff of agent at 



node 2 when not owning an item: uo{2). According to the analysis in Section 4.1, as the discount 



rate S approaches 1 trade will only goes through the cheapest route. Let C be the cost of this 



route, as seen in Section 4.1 we also have 

lims^iui{2) - uo(2) - {ui{l) - mo(1)) = C. 

This is equivalent to 

lims-^iUo{2) + ni(l) = V2 - C. 

In other words, the total surplus of a seller and a buyer approaches the total trading surplus. 
This seems counter- intuitive at first, because this means for every transaction, middlemen only 
make a vanishing amount of fee. However, this effect is due to the fact that sellers and buyers 
are short-lived, while middlemen are long-lived, and thus middlemen can earn a positive payoff by 
accumulating fees over an infinite horizon. 

Now, in the example above, when considering the equilibrium payoff as 6 approaches 1, we have 
if X < 1, sellers and buyers will trade directly, and in this case sellers and buyers equally share the 
surplus, in which case their surplus is = ^. 

On the other hand, if x > 1, then direct trade between sellers and buyers is too expensive, trade 



will go through middlemen at node 3. In the latter case, we will use the analysis in Section 4.2 to 
compute the equilibrium payoff, and we have 

(1) 1 < X < 4/3: Seller's surplus, ni(l) = and buyer's surplus mo(2) = x, so that the buyers 
get all the trade surplus; 

(2) 4/3 < X < 4: Seller's surplus, ui{l) = ^"'^'l);^'''^ = ^ and buyer's surplus no(2) = 
(See Figure |4|. 

Even in this simple network, we observe quite an interesting phenomenon on the discontinuous 
shift in the trading pattern occurring in the network. If the transaction cost C13 = 4 — x between 
1 and 3 decreases the total surplus between sellers and buyers increases, but sellers are actually 
worse off because of this shift in the market structure. This also highlights how local adjustments 
by the sellers could leave them in a worse-off position. 

This example captures an interesting and counterintuitive phenomenon: as the transaction cost 
towards middlemen decreases, sellers can be worse off because of high cost in direct trading, buyers 
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Figure 4. Surplus of seller and buyers as x increases from to 4 



refuse to trade directly and prefer to trade through middlemen. For example, in many supply chain 
networks, as these global networks get large, sellers and buyers do not trade directly and several 
types of organizations emerge as middlemen. In many cases such as in coffee industry, sellers 
(coffee farmers) obtain a very small fraction of surplus because there are too many middlemen in 
the supply chain network. See for example [2] for a related empirical analysis of the coffee global 
supply chain and the recent shift in its market structure. 



In this paper we considered non-cooperative local bargaining over a trading network with a single 
type of good. In the limiting scenario of many agents, we showed the existence of a limit stationary 
equilibrium that can be characterized by a combination of the stationary probability of a trade 
happening on each link and the stationary distribution of the good at the agents. We then showed 
that when agents are patient enough, this limiting equilibrium can exhibit global efficiency. We 
applied this concept to several simple network structures to study the impact of the network on the 
bargaining power and surplus of all agents. In future work we plan to extend the results to more 
general networks, to the trade of multiple goods, and to the analysis of risk of losing or damaging 
the good en route. 
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Appendix A. APPENDIX 

A.l. Proof of Theorem 3.2[ By an application of Kurtz's Theorem [5l Th. 2.1, Chapter 11], 
we obtain a differential equation for the limiting process that is a continuous function from the 
non-negative reals to HiGxlOi-^j] ^ Hjej'iOi^i] ^ rifeeAcI'-*' -^fe]- '^^^ limiting processe^ are given 
as follows for all t > 0, 

Vi G X, Xi{t) = Ni] yk G /C, x^^{t) = 0; 

^ ■' ^ ieX:(i,j)e£2 ■' fee/C:(i,fc)e£:3 

Using a quadratic Lyapunov function (square of the distance to the equilibrium point) it follows 
that there is a unique and globally asymptotically stable equilibrium point that is given by 

Vi G I, X* = Nf, VA; G /C, 4 = 0; 



yj^J, X*=N,, 



^ ^ ^i£X:{i,j)G£2 '^ij^ij + ^k£K:{j,k)G£a '^jk^jk 

Therefore, the fraction of agents with the good satisfies 

Vi G X, fii = 1; \/k £ fC, Hk = 0; 



Vj G J, fij 



J2ieX:{i,j)e£2 '^ij'^ij + Ylk€K:ij,k)ee3 '^jk^jk 



Even though Kurtz's Theorem apphes only for finite time horizons, the compact setting of the scaled processes 
and the well-behaved nature of the differential equation above allow us to analyze the converges of the stationary 
solutions as well. 
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For each m, it is easy to see that the Markov process is irreducible and has finite states, and so is 
positive recurrent. Thus, owing to the compact setting, the stationary measures of the scaled state 
processes converge to the point mass on the equilibrium point as m increases without bound, see 

m 



A. 2. Proof of Theorem 3.3, We need to show that there exists {X,fi,u) satisfying the following 
conditions 

(1) Convergence: given the trading dynamics defined by A, the replicated economy converges 



to the steady state ^. According to Theorem 3.2 this is equivalent to the condition (17) 

(2) Payoff-state consistency: X,^,u need to satisfy the .. 

(3) Payoff-dynamic consistency: if Zij > then Ajj = 1; if Zij < then Ajj = 0; and if 



< Ajj < 1, then Zij = 



F{X,^i,u) = (A,/i',n'), 

where 



Vi G X /X- = 1, 
VA: G /C /i'fc = 0, 



and 



Kij ={1} if uiii) - uoij) - (ni(i) - uoii)) - Qj > 0, 
Aij ={0} if uiij) - Uoij) - (uiii) - uo{i)) - Cij < 0, 
Aij =[0, 1] if ui{j) - Uoij) - (uiii) - uoii)) - Cij = 0. 

Furthermore, 

UQii) =0 for all sellers i G I, 

u'lii) = ^ 9Ar Wi /xw ^^ ~ /^i) max{ui(j) - uo(j) - (ui(i) - uo(i)) - C^, 0} for all sellers i G I, 
u'lik) =Vfc for all buyers k £ IC, 
2Nklnil/6))' 



'^oik) = ^ 9/v, V?n M'l'i ^^' ™ax{ni(A;) - uoik) - (ni(j) - uoij)) - Cjk, 0} for ah buyer k e IC, 

j&JUX 



Uo 



■oO') = ^ OA^. Wl /^W ^^ max{Mi(j) - Uoij) - (^i(^) - ^oii)) - Qj, 0} for aU middlemen j G J, 



^^^2N,lnil/6)) 
IN, 

k&K 



hiJ) = ZL/ 2A^ ln(l/(5)) ^^ ~ ^'''^ max{ni(A;) - no(A;) - - uo(j)) - Cjk, 0} for all middlemen j G 



It is straightforward to check that the function above satisfies all the requirements for Kakutani's 
fixed-point theorem: the domain is a non-empty, compact and convex subset, the mapping is an 
upper hemicontinuous set-valued function and the image of any point in the domain is non-empty, 
closed and convex. Therefore, there must be a fixed-point, and furthermore, by definition, any 
fixed point of this mapping is a limit stationary equilibrium. 
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A. 3. Proof of Theorem \4.2\ The equihbrium equations for this case are as fohows: 



Ul[l) 



2\n{l/5) 



(1 - fij)max{za,0}, 
maxjzb, 0}, 



21n(l/(^) 
Za = S{ui{j) - uo{j) - ui{i)) - a 



{1} Za>0 
{0} Za<0 
[0,1] Za = 



Ah G < 



{1} ^6 > 

{0} zb<0 
[[0,1] zb = 



uo{k) 



TTr, 



2\n{l/S) 



max{za,0}, 
max{zf,, 0}, 



21n(l/5)' 

Zb = 5{V - uo{k) - ui{j) + UQ{j)) - b, 



VTaAa 
TTaAa + VTfeAft 



From the above is clear that ui{i) = (1 — fj,j)uQ(j) and uo{k) = ij,jUi(j). Substituting these we get 
Za = S{ui{j) - (2 - fij)uo{j)) - a, Zb = 6{V -{1 + fJ-j)ui{j) + uo{j)) - b. 

First consider the assumption that trade occurs with probabihty one on both hnks, i.e., Aa = 
Afe = 1. This then implies that fij = ^ , Za,Zb > and we can substitute them directly into the 
equations for the payoffs. We then obtain the following linear equations in uo(i) and ui{j), 

6ui{j) - a 5uo{j) + 5V-b 



21n(l/5) 



We can take limits in the equations above as 5 goes to 1 (along an appropriate subsequence) to get 

^o(j)(2 - Mi) = uiU) - a, ni(j)(l + fij) = uo{j) + V -b. 
The unique solution is 

(2 - fij){V - b) - a V-{l + fij)a-b 



(20) 



1 + - fij 



^1 



V, and at the 



1 + 

It is easily seen that ui{j) > and uo{j) > if and only ii V > {1 + fij)a — b 
equilibrium Za = Zb = 0- 

For the remainder assume that V < V. Consider the case that A^ = 1 and < Aa < 1. This 
then implies that Za = 0, Zb > and fij = ^ A°'+7r6 • ^ga-™ taking a limit of 5 going to 1 (along 



an appropriate subsequence), we also get Zb = 0. If we solve (20), then the calculated uo{j) will 



be negative which then implies that at the equilibrium uo{j) = 0; note that Za = for 6 < 1 also 
yields the same conclusion. Now it follows that 

V-b-a , , TTbiV-b- 



uiU) = a, Hj 



and A„ 



G(0,1). 



Since V <V 



1 + 



TTa{2a + b-V) 

7r +7ri, I CL + b, it also follows that V < 2a + b which ensures fij < 1. Similarly, 



one can verify that Aa G (0, 1). Since the consistency conditions are met, we have an equilibrium. 

The uniqueness of the solution in both cases also proves that the same solution holds along 
every subsequence of 6 converging to 1 (from below) so that the uniqueness of the equilibrium also 
follows. Finally, we can verify that there can be no other equilibria. 



